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Extended Abstract 


a 

Computational Fluid Dynamics (CFD) is the standard numerical tool used by Fluid 
Dynamists to estimate solutions to many problems in academia, government, and industry. 
CFD is known to have errors and uncertainties and there is no universally adopted method 
to estimate such quantities. This paper describes an approach to estimate CFD uncertainties 
strictly numerically using inputs and the Student-T distribution. The approach is compared 
to an exact analytical solution of fully developed, laminar flow between infinite, stationary 
plates. It is shown that treating all CFD input parameters as oscillatory uncertainty terms 
coupled with the Student-T distribution can encompass the exact solution. 

Nomenclature 

= channel width 

8d 

= experimental error 

8lnput 

= input error 

Smodel 

= modeling error 

5num 

= numerical error 

6s 

= simulated error 

D 

= experimental value 

dp/dx 

= pressure gradient 

£21 

= solution changes medium to fine grid 
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£32 


= solution changes coarse to medium grid 


e a 21 = extrapolated error 

E - comparison error 

GCIf ine 21 = grid convergence index 

h = representative grid size 

p = observed order 

Rk = convergence parameter 

f 2 i = ratio of grid sizes between grid 1 and 2 

r32 = ratio of grid sizes between grid 3 and 2 

S = simulated result 

Ski = solution variable for fine grid 

Sk 2 = solution variable for medium grid 

Sk3 = solution variable for coarse grid 

S ext = extrapolated solution variable 

Sl = lowest solution variable 

Su = highest solution variable 

Uosciiiatory = uncertainty for oscillatory portion of the solution 

Umonotonic = uncertainty for monotonic portion of the solution 

Uinput = input uncertainty 

u D = experimental uncertainty 

Unum = numerical uncertainty 

Uyai = validation uncertainty 

p = viscosity 

I. Introduction 

^~^FD in many problems is the optimum balance between cost and accuracy. However, a comprehensive approach 
for verification using test data is needed for full validation. With shrinking budgets in all areas of aerospace 
industry, CFD is commonly used without proper verification and validation. This paper couples traditional 



uncertainty analysis with the Student-T distribution to estimate a numerical uncertainty without using test data. The 
results are compared to the exact analytical solution of fully developed, laminar flow between infinite, stationary 
plates. 

A thorough literature review was performed by the authors in AIAA-2013-0258 1 and it was determined that the 
current state of the art for CFD uncertainty analysis is the ASME Standard for Verification and Validation in 
Computational Fluid Dynamics and Fleat Transfer 2 . The standard outlines a validation approach using experimental 
errors, modeling assumptions, simulation inputs, and numerical solutions of equations. The error, E, and validation 
standard uncertainty u va i, can be defined and conclusions drawn about whether the model is properly verified. This 
paper outlines a method to estimate the numerical uncertainty without using test data and shows the differences 
between the proposed methodology and the ASME Standard. 


II. Methodology of ASME V& V 20-2009 

A schematic showing the nomenclature and an overview of the validation process is shown in Figure l 2 . The left 
side of the figure describes the terminology and the right side describes the validation process. 
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Figure 1: Schematic of nomenclature and Overview of Validation Process 2 


The methodology is as follows. The validation comparison error, E, is the difference between the simulated 
result, S, and the experimental value, D 2 . The goal is to characterize the interval modeling error, 5 mode i. The 
coverage factor, k, used to provide a given degree of confidence (ie 90% assuming a uniform distribution, k=1.65) 2 . 








The standard also outlines procedures to calculate numerical uncertainty, u num , the uncertainty in the simulated result 
from input parameters, Ui nput , and the experimental uncertainty, ud 2 . 

^ model e[E u val ,E + u wa ;] (1) 

E = S-D (2) 

^ val k "h tt input 2 "1" ) (3) 

Unum is calculated using a Richardson’s Extrapolation approach and defined as a five-step procedure 2 . 

Step 1, calculate representative grid size, h as shown in equation 4. 
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Total Volume 


total number of cells in fine grid) 
Total Volume 


total number of cells in medium grid) 


h * ~ (' 


Total Volume 


total number of cells in coarse grid, 


u) 


Step 2 is to select three significantly (r>l .3) grid sizes and computer the ratio as shown in equation 5. 



(4) 



(5) 


Step 3 is to calculate the observed order, p, as shown in equation 6 2 . This equation must be solved iteratively. 


£21 = Sk2 - Ski 


E32 = Sk3 ~ Sk2 


p - • I |n fe) + ,n 


Step 4 is to calculate the extrapolated values as shown in equation T. 

„ 21 ( r 21 P * $kl ~ Ski) 


J ext 


( r 2! P - 1) 


( 6 ) 
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Step 5 is to calculate the fine grid convergence index and numerical uncertainty as shown in equation 8 2 . This 
approached used a factor of safety of 1.25 and assumed that the distribution is Gaussian about the fine grid, 90 % 


confidence. 


GCIfine 


21 _ 1-25 * e a 21 
( r 21 P - 1) 


_ GCI fine‘ 
u num ~ , 


Uinput is calculated using a Taylor Series expansion in parameter space 2 . 

U input = W 

Ud is calculated using test uncertainty methodology as defied in the standard 2 . The purpose of this paper is to 
show an estimate of numerical uncertainty without test data. The reader is referred to the ASME standard for further 
information. 


III. Proposed Methodology without Test Data 

Convergence studies require a minimum of three solutions to evaluate convergence with respect to an input 
parameter 3 . Consider the situation for 3 solutions corresponding to fine S ki , medium S k2 , and coarse S k3 values for 
the kth input parameter 3 . Solution changes £ for medium-fine and coarse-medium solutions and their ratio R k are 


defined by 3 : 


£21 = Sk2 - Ski 


£32 = Sk3 - Sk2 


Rk = £21 / £32 


Three convergence conditions are possible 3 : 


(i) Monotonic convergence: 0< R k <1 

(ii) Oscillatory convergence: R k < 0' 

(iii) Divergence: R k >l (11 

The methodology outlined in ASME V&V-2009 2 assumes monotonic convergence criteria for u num - Further 

increasing the grid does not always provide a monotonically increasing result. This is shown in AIAA-2013-0258 1 . 
The proposed methodology is to treat all input parameters including the grid as an oscillatory convergence study. 
The uncertainty for cells with oscillatory convergence, using the following method outlined by Stem, Wilson, 
Coleman, and Paterson 3 , can be calculated as follows in equation 12. S is the simulated result. For this case it is 


the upper velocity SVand the lower velocity S L . 



( 12 ) 


U Oscillatory ~~ *^L 

The proposed methodology as compared to the ASME Standard is as follows. If there is no experimental data, 
D=0, 8d=0, and Ud=0. 

E =S-D =S 
Ss = S — T 

E = S - D = T + Ss - (T + S D ) = S s - S D = S s 

u val ~ k Tium 2 T ^inpuc 2 T ^D 2 ) = u val = ^ (.-JUnum 2 "l” ^ in-put 2 ) (13) 

Report the simulated result, S as S ±u val (14) 

Also instead of assuming a gauss-normal distribution as in the standard when including test data, the k-value will 
come from the Student-T distribution as shown in Table 1 . 

Table 1 - Student - T Distribution, k Values 


Number of Cases 


Degrees of Freedom 


Confidence 90% 


2 

3 

4 

5 

6 

7 

8 

9 

10 
11 
12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 

25 

26 

27 

28 

29 

30 

31 
41 
51 
61 
81 
101 
121 
infty 


1 

2 

3 

4 

5 

6 

7 

8 

9 

10 
11 
12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 

25 

26 

27 

28 

29 

30 
40 
50 
60 
80 
100 
120 
infty 


6314 
2.92 
2,353 
2.132 
2.015 
1 943 
1.895 
1.86 
1.833 
1.812 
1.796 
1.782 
1.771 
1.761 
1.753 
1.746 
1.74 
1.734 
1.729 
1.725 
1.721 
1.717 
1.714 
1.711 
1.708 
1.706 
1.703 
1.701 
1.699 
1.697 
1.684 
1.676 
1.671 
1.664 
1.66 
1.658 
1.645 














































































































IV. Fully Developed Laminar Flow Between Stationary Parallel Plates 


Fully developed laminar flow between stationary, parallel plates is an exact solution to the Navier-Stokes 
Equations as derived in “Introduction to Fluid Mechanics” 4 . The width of the channel is (a). 




( 14 ) 


A CFD model of this problem was created in FLUENT. The fluid is air. Table 2 outlines the parameters 


used. 


Table 2 - Parameters 


a(m) 

0.1 

rho (kg/m3) 

1.225 

mu (Ns/m2) 

0.00001789 

dp/dx (N/m3) 

-0.000400 


The exact solution is shown in Figure 1. 



Figure 1 - Exact Solution 


A CFD model was created for the same conditions and the uncertainty calculation performed as outlined in 


the next section. 


V. Uncertainty Calculation 


The uncertainty can be calculated by expanding equation 13 for pressure, density, numerical (grid), and solver. 

u val = 

k * 


( (fe) ! s— .) + ((S 2 *.) + (( 3=) 2 «-) + (fc^) 2 


+ 


+ 


((: 


dV 


) Bl 


dvelocity) velocity 




(15) 


The proposed method is to calculate the uncertainty as an oscillatory input parameter and multiply by the 
appropriate Student-T k-factor. 

For Numerical, three grids were used and the t value of 2.92. 

u val = 2.92 * ^ ((^^) B num) ) (16) 

u val = 2.92 * |i(Sy -Sj| (17) 

The centerline velocity was chosen as an example to plot, however at all points the uncertainty bands always 
encompass the exact solution. 
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Centerline Velocity vs Exact Solution 
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Figure 2 - Exact Solution vs. CFD with Uncertainty (Centerline Velocity) - Grid 


If there is also a variation in the inlet velocity due to a tolerance or known bias, run the model at the low and high 


limits and use a new t- value of 2.132, which corresponds to five cases. The five cases would be three for grids and 
two for flow rates. A five percent variation in inlet velocity was chosen for this example. 

“«■' - 2132 * ( ((=) 2 + ( fe £ n ;) 2 ^ <18) 

u vai = 2.132*|i(S l/ -S i )| (19) 





Centerline Velocity vs Exact Solution 














——EXACT 

O.QSS 





-CfDfme 





—CFD Med 

I 

| 

& 





"CFD coarse 





•—EXACT 


m 

w 

m 

— ^Uncert Jow 

► 





■ Uncenhigh 






—CFD fine 






— CEO Med 






•— *Cf D coarse 






•■■•Inlet Velocity Low 

0 024 

0025 

0 026 0.02 7 0.028 0.029 0 03 

Velocity (m/s) 

0.031 

0.032 1 Inlet Velocity High 


Figure 3 - Exact Solution vs. CFD with Uncertainty (Centerline Velocity) - Grid and Inlet Velocity’ 



Also to include the outlet pressure boundary condition, run the model at the low and high known bias or tolerances 
and use a new t-value of 1.943, which corresponds to seven cases. The seven cases would be three for grid, two for 
flow rate, and two for pressure outlet boundary condition. 


u vai = 1.943 * 
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dnumJ 
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( 20 ) 


u val = 1.943 *|± (S„-S L ) | 


( 21 ) 


Centerline Velocity vs Exact Solution 
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Figure 4 - Exact Solution vs. CFD with Uncertainty (Centerline Velocity) - Grid, Inlet Velocity, and Outlet 

Pressure 


To account for the variation in fluid properties, the kinematic viscosity for air between 0 and 100 degrees Celsius is 
13. 6X1 O' 6 to 23. 06X1 O' 6 . The model was run at these limits to account for the possible variation in fluid properties 
and a new value of t= 1 .86 was chosen, which corresponds to the nine cases. 


u val = 1-86 * ( ((^^) 2 Bnum) + (( 
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( 22 ) 



V portion |m) 


u„ al = 1.86*|i(S [/ -S L )| 
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Centerline Velocity vs Exact Solution 
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Figure 5 - Exact Solution vs. CFD with Uncertainty (Centerline Velocity) - Grid, Inlet Velocity, Outlet 

Pressure, and Density 


Fluent has been used to calculate the results above; we also consider the solver as an input to the model. To 
account for the variation in the solver, the model was run in OpenFOAM. The t value was updated to 1.833 because 
the numbers of cases are ten. 


u„, = 1,833. (((,£-)’ B*„t» 


Mo 


JZ \ 2 d2 
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u vai = 1.833 *|i(S„-S L )| 


(23) 
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Centerline Velocity vs Exact Solution 


0.027 0.021 

Velocity (m/s) 


——EXACT 
CfDfine 
— CfOMed 
***-CfD coarse 
EXACT 

•H^UncertJow 
• Uncerthigh 
JDfme 
) Med 
•♦•CFD coarse 
^•—Iniet Velocity Low 
1 'Inlet Velocity Higti 
■ ♦ ■ Q PtNFOAM 


Figure 6 - Exact Solution vs. CFD with Uncertainty (Centerline Velocity) - Grid, Inlet Velocity, Outlet 

Pressure, Density, and Solver 

Figure 7 is a plot of all the CFD cases, uncertainty, and an exact comparison. 



Figure 7 - Exact Solution vs. CFD with Uncertainty (Parallel Plates - Half of Domain) - Grid, Inlet Velocity 

Outlet Pressure, Density, and Solver 



VI. Conclusion 


It can be concluded that treating all inputs to a CFD model as oscillatory uncertainty parameters coupled with the 
Student-T distribution can supply an uncertainty estimate that encompasses the exact solution for the case 
considered above (fully developed, laminar, flow between stationary parallel plates). To summarize the approach 
and general idea, there is a standard 2 for calculating verification and validation of CFD using a combined numerical 
and experimental data. The approach described above is a way to estimate the uncertainty of a model if test data is 
not available. An analyst should make use of all test data that is available or able to be funded and use the ASME 
standard. However, if test data is missing or not attainable, the method described makes assumptions that each CFD 
solution belongs to an underlying Student-T distribution and a corresponding uncertainty can be estimated for a 
selected confidence interval. 
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